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ENGINEERING  AND  DESIGN  -COST/RATE 
FORECASTING  SYSTEM— VOLUMt  I. 

MODEL  DEVELOPMENT  AND  DATA  ANALYSIS 


1 INTRODUCTION 


Background 

The  Directorate  of  Military  Construction  (DMC)  of  the  Office  of  the 
Chief  or  Engineers  (GCE)  annually  establishes  engineering  and  design 
(E&D ) cost  targets  for  military  construction  for  each  Corps  of  Engineers 
Division/District.  These  targets,  expressed  as  a percentage  of  the 
dollar  value  of  construction  designed,  are  currently  established  by  an 
empirical  procedure  based  oh  the  previous  4 to  5 years  of  Oivisidn/Dis- 
trict  performance  and  the  estimated  cost  of  construction  (F.CC)  for  the 
next  fiscal  year.  Previous  work1  has  shown  that  statistical  analysis 
methods  can  be  used  to  predict  future  E&D  costs  for  individual  Di- 
visions/Districts using  historical  data,  OCE  requested  that  CERL  de- 
velop similar  methods  for  predicting  contract  and  in-house  E&D  costs. 

Use  of  such  methods  to  develop  mathematically  valid  forecast  models 
would  result  in  more  reliable  and  precise  forecasts.  Such  forecasts 
should  have  an  accuracy  of  ±10  percent. 


Objective 

The  objective  of  this  study  is  to  develop  statistically  based 
models  for  forecasting  E&D  in-house  and  contract  costs  separately;  these 
predictions  will  help  DMC  establish  E&D  cost  targets  for  each 
Division/District. 


Approach 

Available  data  for  the  pertinent  variables  was  obtained  and  re- 
viewed and  a model  relating  these  variables  was  postulated;  regression 
analysis  was  used  to  fit  the  model  to  the  data.  Finally,  the  model's 
capability  of  accurately  forecasting  E&D  rates  was  determined. 


* M.  J.  O'Connor,  3.  J»  Brown  and  J.  R.  DeCardy,  Military  Construction 
Engineering  and  Design  Forecasts,  Technical  Report  P-77/ADA035262  {'J.S. 
Army  Construction  Engineering  Research  Laboratory  [CERL],  January 
1977). 


2 METHOD  OF  DATA  REVIEW 


E&D  cost  data  were  abstracted  from  the  OCE  "Program  Review  and 
Analysis:.  Division- and  District  Performance  Data  Reports"  for  the  9- 
year  period  from  FY69  through  FY77  (see  Appendix  A).  Prior  to  FY71,  the 
ECC  was  defined  as  85  percent  of  the  .programmed  cost;  if  the  programmed 
cost  was  not  established,  the  ECC  was  the  equivalent  cost.  In  the 
second  quarter  of  FY71,  this  percentage  was  changed  to  90  percent.  The 
FY69  and  FY70  data  were  adjusted  to  conform  to  the  p6st-FY-70  definition. 

In  addition,  data  for  the  Baltimore  and  Omaha  Districts  were  adjusted 
for  the  years  when  they  absorbeddE.&D  work,  from  the  ,Nor folk  and  Kansas 
City  Districts.  Appendix  B provides  information  about  these  adjust- 
ments-. 

CERL  Report  P-77  us*d  data  available  through  FY66  for  analysis. 

These  analyses  related  tne  District  yearly  total  E&D  costs,  to  ECC.  For 
the  present  study,  the  total  ESD  costs  were  split  into  in-house  (I MED) 
and  contract  (AEED)  costs  for  analysis  purposes.  It  was  not  possible  to 
split  FY66,  FY67,  and  FY68  E&D.  costs  into  INHED  and  AEED;  therefore,  a 
maximum  of  9 years'  data  was  available. 

Data  for  the  following  Divisions/Districts  were  not  analyzed,  since 
less  than  9 years  of  data  were  available  for  them: 

1.  European  Division 

2.  Huntsville  Division 

3.  Kansas  City  District 

4.  Norfolk  District 

5.  Los  Angeles  District. 

Tfie  Mediterranean  Division  and  the  Middle  East  Division  were  elimi- 
nated because  the  recent  Saudi  Arabian  Government  workload  has  distorted 
their  historical  data.  The  following  Divisions/Districts  had  sufficient- 
data  for  analysis: 

1.  Alaska  District 

2.  Baltimore  District 

3.  Fort  Worth  District 

4.  Mobile  District 

5.  New  York  District 

5.  Omaha  District 

7.  Pacific  Ocean  Division 

8.  Sacramento  District 

9.  Savannah  District. 
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3 MODEL  DEVELOPMENT  AND  DATA  ANALYSIS 


CERL  Report  P—77  showed  that  the  following  model  was  appropriate: 


Di  - + b.^C  + b2^T  + b^TC 


(Eq  1) 


where  DI  = predicted  E&D  costs  for  the  1th  Division/dt strict  ($  MIL) 
C = estimated  cost  of  construction  ($  MIL)* 


C = estimated  cost  of  construction  ($  MIL)- 

,T  = time  period  (FY69=1,  FY70=2 ) 

TC  = I x C 

^01’  h119  ^21*  ^31 » = coefficients  for  the  ith  Division/District. 


This  mcdel  was  found  satisfactory  for  estimating  both  in-house  and 
contract  E&D  costs.  Thus,  for  each  District: 


!NHEDi  = bQi  + bLiC  + B2iT  + B3.TC 


AEEDi  = b’0.  + b5  X1 C + b‘21T  + b'3ifC 


where  INKED.  = in-house  E&D  cost  for  ith  Division/District 


. AEED,  = contract  E&D  cost  for  ith  Division/District 


bftll  b.. , b,.,  b,j  = coefficients  for  in-house  costs  for 

the  ith  Division/District 


b'ni>  b1.,,  b',,,,  b'o^  = coefficients  for  contract  costs  for 

the  ith  Division/District 


E&D  rates  are  defined  as 


trict 


INHR^  = 100  x INHED^/C  = In-house  rate  for  the  ith  Division/Dis- 


trict 


AEED.J  = 100  x AEED^/C  = contract  rate  for  the  ith  Di vi sion/Di s- 


Regression  analyses  showed  significant  differences  among  Di- 
visions/Districts for  both  in-house  and  contract  E&D  costs.  Each  model 
used  significantly  different  coefficients;  i.e.,  no  one  set  of  coeffi- 
cients can  be  used  for  all  Divisions/Districts.  This  means  that  the 
total  data  cannot  be  pooled  to  determine  one  set  of  coefficients.  In- 
stead, Division/Districts  must  be  put  into  homogeneous  groups,  or 


r ‘ 


i .xr  'i  ' 


[ 4,  , 

1 ■ 
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treated  individually.  Since  it  would4  be  very, difficult  to  use  the  TEK- ' 
TRONIX  4051*  to  check  for  homogeneous  groupings  as  additional  years' 
data  are  added,  a model  was  developed  for  each  Division/District. 

In  addition  to  the  .model  of  Eq  1,  another  model  which  v,onsisted  of 
Eq  1 plus  a T^**  term  was  examined.  Graphs  of  E&D  costs  vs.  time  (Ap- 
pendix B)‘  indicated  that  for  some  Divisions/Districts,  such  a quadratic 
effect  over  time  might  explain. a large =part  of  the  data  variation.  How- 
ever, analysis  showed  that  the  basic  model  (Eq  1)  was  adequate. 


* The  model  developed  is  programmed  for  use  by  DMC  personnel  on  the 
TEKTRONIX  4051  graphics  system  in  OCE. 

**A  quadratic  tsnn  in  time. 
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4 MOOEL  RESULTS  AND  VERIFICATION 


Resul ts 

« o The  model  provided  good  estimates  of  AEED* costs  for  most  Districts 

o and  good  estimates  of  total  E&D  costs  for  all  Districts;  however,  for 

all  D1vision,s/DistHcts,  the  model  provided  only  fair  estimates  of  INHED 
costs.  This  was  expected,  since  INHEDl'COsts  are  affected  by  staffing 
9 limitations  and  the  quantity  of  work  other  than  E&D  and  are  thus  highly 

constrained.  AEED  costs  and  total  costs  can  more  readily  vary  with 
changes  In  the  ECC. 

^ Table  1 shows  the  regression  results  for  the  nine  Diyisions/Dis- 

tricts.  In  each  case,  the  best  model  for  AEED,  INHED,  and  total  E&D 
costs  is  given  with  the  standard  error  of  estimate  and  the  square  of  the 
multiple  correlation  coefficient  (R2).* 

3 Criteria  for  a good  model  are  (1)  that  R^  - .90,  and  (2)  the  stan- 

dard error  <10  percent  of  the  data  average  (i.e.,  coefficient  of 
variability  <10  percent).  For  contract  E&D  costs,  models  for  two  Dis- 
tricts failed  the  r2  criterion,  while  five  failed  the  coefficient  of 
variability  criterion.  For  in-house  costs,  the  best  models  for  all  Dis- 
f tricts  failed  both  criteria.  Models  for  total  E&D  costs  fared  better; 

the  model  for  one  District  failed  both  criteria,  but  all  the  other  Dis- 
0 trlct  models  passed.  This  means  that  the  models  for  in-house  costs  gen- 

orally  will  not  forecast  future  years'  costs  as  well  as  the  models  for 
contract  and  total  costs. 

Figures  1 through  9 show  the  FY78  prediction  equations  and  graphs. 
The  prediction  limits  indicate  the  accuracy  of  the  prediction.  For  ex- 
ample, for  Baltimore  District  (Figure  2),  if  the  estimator  assumes  an 
ECC  of  $150  million  in  FY78,  he/she  can  be  95  percent;  confident  .that  the 
contract  E&D  cost  will  range  between  $6.1  and  $7.4  million  and  that  the 
v'  in-house  E&D  cost  will  range  between  $.8  and  $1.8  million.  Cor- 

< $ respondingly,  the  contract  E&D  rate  will  range  between  4.1  and  4.8 

percent,  and  the  in-house  E&D  rate  will  range  between  .6  and  1.2 
percent. 

The  in-house  and  contract  rates  are  based  on  the  total  ECC.  It  is 
not  possible  to  separate  the  ECC  for  which  E&D  was  done  in-house  from 
ECC  for  which  E&O  was  contracted.  Thus,  the  contract  and  in-house  E&D 
percentages  (rates/  in  this  report  are  based  on  the  total  ECC.  Such  a 

*The  standard  error~Ts~a  measure  of  the  amount  of  variation  of  the  data 
about  the  prediction  model.  R2  is  the  irultiple  correlation  coefficient 
\ squared;  when  multiplied  by  100,  it  is  line  percent  of  the  variation  in 

the  data  which  is  explained  by  the  model. 
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separation  and  regression  of  INHED  and  AEED  in  terms  of  the  appropriate 
ECC  is  desirable,  since  such  models  should  be  more  accurate. 

A number  of  different  options  could  be  tried  to  get  the  appropriate 
mix  of  in-house  versus  contract  design  but  the  model  has  not  accurately 
depicted  conditions  at  the  lower  range  for  in-house  effort.  Therefore 
extreme  caution  should  be  used  if  this  is  attempted. 

The  prediction  limit  graphs  are  plotted  over  reasonable  ranges  of 
ECC  for  each  District.  It  would  not  be  correct  to  use  the  graphs  if  the 
next  year's  ECC  is  expected  to  be  two  or  three  times  larger  than  the  ECC 
for  FY77  or  if  it  is  expected  to  be  only  one-half  or  one-fourth  as 
large;  i.e.,  strch  drastic  changes  in  ECC  would  require  the  Division/Dis- 
trict to  operate  differently  than  in  the  past  few  years,  and  the  model 
would  not  reflect  this  change  adequately. 


Verification 


The  8 years  of  data  from  FY69  through  FY76  were  used  to  generate 
regression  coefficients  and  to  predict  the  FY77  E&D  costs.  Table  2 
shows  the  results  of  this  verification.  Note  that  only  one  of  18  pre- 
dictions was  outside  the  95  percent  prediction  limits.  However,  some  of 
the  limits  are  very  wide  because  of  high  variability  of  data  within  a 
District/Division.  (Note:  the  verification  analysis  was  performed 
using  the  full  model  [Eq  1]). 

The  model's,  predictions  are  much  more  accurate  for  contract  costs 
than  for  in-house  costs.  This  is  obvious  by  how  much  the  FY78  predicted 
value  deviates  from  the  actual  value.  — 

In  Table  2,  the  percent  deviations  of  the  predicted  FY77  E&D  costs 
from  the  actual  costs  show  that  the  in-house  models  are  not  very  accu- 
rate (8  of  the  9 predictions  deviated  by  more  than  10  percent).  Five  of 
the  nine  contract  percent  deviations  were  within  10  percent,  while  six 
of  the  total  E&D  deviations  were  within  10  percent  (Table  3). 

Table  3 thows  how  well  the  model,  which  is  based  on  total  E&D  costs 
vs.  time  at  1 ECC,  predicts  the  FY77  E&D  cdsts.  Note  that  the  sum  of  the 
predicted  contract  and  in-house  costs  from  Table  2 is  the  same  as  the 
predicted  total  E&D  costs  for  each  District/Division. 

With  only  9 years'  data  available,  forecasts  for  2 years  in  advance 
were  not  attempted  and  are  not  recommended.  The  model  should  only  be 
used  for  forecasts  1 year  in  advance  until  at  least  11  years'  data  are 
available. 


E AND  D COST/RATE  VS  ESTIMATED  COST  OF  CONSTRUCTION 

ALASKA  CTOTALD  - FY78 

PREDICTED  VALUE 

™ 95*  PREDICTION  LIMITS 


Ece  ECC  <$*J8**6:> 

c.  Total 
Figure  1 (con't) 


E AND  D COST/RATE  VS  ESTIMATED  COST  OF  CONSTRUCTION 

FORT  WORTH  C CONTRACT  - FY78 
PREDICTED  VALUE 


48  88  128  168  288  248  288  320  40  88  128  !68  200  240  280  320 

ecc  c$*i8***6:>  ecc  c$H8**e:> 

a.  Contract 

Figure  3.  Prediction  of  E&D  Costs/Rates  - Fort  Worth'-  FY78  • 


E AND  D COST/RATE  VS  ESTIMATED  COST  OF  CONSTRUCTION 

FORT  WORTH  CINHOUSE)  - FY78 

PREDICTED  VALUE 

9S*  PREDICTION  LIMITS 


88  1 28  168  288  248  288  828  48  88  128  168  288  248  288  328 

ECC  C$*!8*»6:>  ECC  <$*18>»*6:> 

b.  In-House  . 

Figure  3 (con't) 


40  80  1 20  160  200  240  280  320  40  80  120  /60  200  240  280  320 

ECO  <$*I0*»*6;>  ECC  <$*!0**6> 

c.  Total 

Figure  3 (con’t) 


E AND  D COST/RATE  VS  ESTIMATED  COST  OF  CONSTRUCTION 

MOBILE  C CONTRACT}  - FY78 
PREDICTED  VALUE 


E AND  D COST/RATE  VS  ESTIMATED  COST  OF  CONSTRUCTION 

MOBILE  CINHOUSED  - FY78 
PREDICTED  VALUE 


b.  In-House 
Figure  4 (con’t) 
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Figure  5.  Prediction  of  E&D  Costs/Bates  - New  York  - FY78 
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E AND  D COST/RATE  VS  ESTIMATED  COST  OF  CONSTRUCTION 

OMAHA  CINHOUSED  - FY78 


ECC  ECC 

b,;  In-House 

Figure  6 (con't) 


C$*|8»m*6> 


48  88  128  168  200  248  288  320  40  80  128  168  208  240  280  320 

ECO  C$»18*»6:>  a.  contract  ECO  Ci*10*»6:> 

Figure  8.  Prediction  of  E&D  Costs/Rates  - Sacramento  - FY78  • 


ECO  x , Etc 

c.  Total 
Figure  8 (con’t) 
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b.  In-House 
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Table  3 

FY77  Prediction  of  Total  E&D  Costs 


Dist’/Div 

Actual 

•Predicted 

Deviation  and 
Percent 

95%  Limits 
Lower  Upper 

Alaska 

2654 

2939 

-285  (11%) 

2463 

3414 

Bal timore 

7465 

7341 

124  (2%) 

6300 

8383 

Fort  Worth 

12150 

12854 

-703  (6%) 

10941 

14767 

Mobile 

1 

7616 

8827 

-1211  (16%) 

7563 

10091 

New  York 

2754 

2737 

17  (1%) 

2077 

3397 

Omaha 

7813 

7666 

147  (2%) 

5855 

9478 

Pacific  Ocean 

5835 

3132 

2703  (30%) 

372 

5892 

Sacramento 

9749 

9355 

394  (3%) 

8669 

10041 

Savannah 

9722 

9364 

368  (4%) 

7048 

9365 

I 
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5 MODEL  USE  AND  MAINTENANCE 


The  model  can  be  used;  to  predict  In-house,  contract,  and  total  E&D 
costs/rates  for  a particular  DiVi si on/DI strict  based  on  its  past  per- 
formance. These  estimates  can  be  used  by  DMC  to  establish  targets.  DMC 
must  exercise  its  managerial  control  in  using  these  estimates.  Changes 
in  OCE  policy,  in  Divisions/Districts'  available  manpower,  or  in  as- 
signed workload  (type  and  quantity)  will  all  influence  the  final  E&D 
rates.  Additionally,  the  Division/District  performance  is  influenced  by 
the  established  target;  i.e.,  the  target  may  be  such  that  major  changes 
in  management  procedures  or  operations  are  required  to  meet  it,  while 
past  data  is  based  on  prior  management  procedures  or  operations.  Thus, 
the  estimates  predicted  by  the  model  should  be  considered  as  good  guides 
for  setting  target  rates  only  when  they  are  combined  with  other  manager- 
ial information1.' 


6 CONCLUSIONS  AND  RECOMMENDATIONS 

% 

The  model  presented  in  this  report  is  valid  for  predicting  future 
E&D  costs;  however,  caution  should  be  used  when  applying  the  in-house 
predicted-  values. 

The  model  is  best  used  to  project  costs  1 year  in  advance.  Thus, 
as  soon  as  an  additional  year's  data  is  available,  the  model  should  be 
updated. 

It  is  recommended  that  DMC  use  the  model  to  help  establish  E&D 
targets  for  applicable  Divisionjs/Districts. 


APPENDIX  A: 

DATA  FOR  FY69  THROUGH  FY77 


ALASKA  DISTRICT 


FY. 

ECC 

($  Mil) 

Adj  ECC 
($  Mil) 

E&D  Cost 
($  Mil) 

E&D  Rate 
(%) 

Contract 
E&D  Cost 
($  Mil) 

In-House 

E&D  Cost 
($  Mil) 

1969 

1-5.526 

17.498 

1.157 

6.612 

.017 

1.140 

1970 

15.326 

16.238 

1.201 

7.396 

.043 

1.158 

1971 

11.550 

11.550 

.867 

7.506 

.025 

.842 

1972 

8.156 

8.156 

.612 

7.504 

.017 

.595 

1973 

21.025 

21.025 

1.170 

5.565 

.308 

.862 

1974 

29.340 

29.340 

1.681 

5.729 

.926 

.755 

1975 

26.589 

26.589 

1.444 

5.431 

.807 

.637 

1976 

32.841 

32.841 

2.210 

6.729 

.869 

1.341 

1977 

38.552 

38.552 

2.654 

6.890 

1.376 

1.278 

Note: 

The  E&D 

rate  is  based  on  total 

E&D  cost. 

BALTIMORE  DISTRICT 

Contract 

In-House 

FY 

ECC 

Adj  ECC 

E&D  Cost 

E&D  Rate 

E&D  Cost 

E&D  Cost 

($  Mil) 

($  Mil) 

($  Mil) 

(%) 

($  Mil) 

($  Mil) 

1969 

33.714 

35.697 

2.228 

6.24)1 

1.345 

.883 

.1970 

44.262 

46.865 

2.654 

5.663 

2.051 

.603 

1971* 

86.439 

86.439 

4.225 

4.888 

3.731 

.494 

1972* 

133.997 

133.997 

6.480 

4.836 

5.961 

.519 

1973* 

152.460 

152.460 

7.813 

5.125 

7.028 

.785 

1974 

152.560 

152.560 

7.380 

4.837 

6.462 

.918 

1975 

128.000 

128.000 

6.594 

5.152 

5.655 

.939 

1976 

106.050 

106.050 

5.654 

5.331 

4.632 

1.022 

1977 

138.535 

138.535 

7.465 

5.389 

6.361 

1.104 

*Data  adjusted  to  reflect  that  no  E&D  was  performed 
in  Norfolk  District. 


EUROPEAN  DIVISION 


FY 

ECC 

($  Mil) 

Adj  ECC 
($  Mil) 

E&D  Cost 
($  Mil) 

E&D  Rate 
(%) 

Contract 
E&D  Cost 
($  Mil) 

In-House 

E&D  Cost 
{$  Mil ) 

1969 

10.830 

11.467 

.769 

6.706 

1970 

12.853 

18.080 

1.086 

8.303 

1971 

1972 

1973 

1974 

1975 

137.713 

137.713 

11.041 

8.017 

4.610 

4.720' 

1976 

102.919 

102.919 

5.967 

5.798 

5.241 

.726 

1977 

221.943 

221.943 

14.863 

6.697 

13.511 

1.352 

FORT.  WORTH  DISTRICT 

Contract 

In-House 

FY 

ECC 

Adj  ECC 

E&D  Cost 

E&D  Rate 

E&D  Cost 

E&D  Cost 

($  Mil) 

($  Mil) 

(S  Mil) 

(%) 

($  Mil) 

($  Mil ) 

1969 

74.778 

79.176 

4.435 

5.601 

2.394 

2.041 

1970 

53.133 

56.258 

3.969 

7.055 

1.300 

2.669 

1971 

75.350 

75.350 

4.896 

6.498 

2.067 

2.829 

1972 

104.900 

104.900 

6.128 

5.842 

4.094 

2.034 

1973 

122.985 

122'.  985 

6.921 

5.628 

5.551 

1.370 

1974 

145.416 

145.416 

8.055 

5.539 

6.532 

1.523 

1975 

204.842 

204.842 

10.141 

4.951 

8.183 

1.958 

1976 

288.839 

288.839 

14.892 

5.156 

13.389 

1.503 

1977 

230.684 

230.684 

12.150 

5.267 

10.532 

1.618 

HUNTSVILLE  DIVISION 


, < 

FY 

:ECC 
($  Mil) 

Adj.  ECC 
($Mil) 

E&D  Cost 
($  Mil) 

E&D  Rate 
(%) 

Contract 
E&D  Cost 
($  Mil ) 

In-House 

E&D  Cost 
($  Mil) 

i 

1970 

204.532 

216.563 

8.184 

3.779 

5.041 

3.143 

1971 

241.000 

241.000 

9.733 

4.055 

6.264 

3.469 

1972 

216.700 

216.700 

9.369 

4.323 

8.134 

1.235 

1973 

91.836 

91.836 

4.875 

5.308 

4.140 

.735 

1974 

48.527 

48.527 

2.426 

4.999 

1.340 

1.086 

1975 

180.712 

180.712 

11.041 

6.110 

5.592 

5.449 

1976 

97.282 

97.282 

5.301 

5.449 

4.583 

.718 

s 1-1 

1977 

95.335 

95.335 

6.607 

6.930 

4.453 

2.154 

KANSAS  CITY  DISTRICT 

Contract 

In-House 

FY 

ECC 

Adj  ECC 

E&D  Cost 

E&D  Rate 

E&D  Cost 

E&D  Cost 

($  Mil) 

($  Mil) 

($  Mil) 

U) 

($  Mil) 

($  Mi  l ) 

1969 

50.116 

53.064 

2.169 

4.088 

1.663 

.506 

1970 

20.920 

22.151 

1.276 

5.761 

.976 

.300 

XWP 

1971 

1972 

1973 

*jW' 

1974 

1975 

5.843 

5.843 

.315 

5.391 

.210 

.105 

1976 

37.339 

37.339 

2.447 

6.553 

1.777 

.670 

^ f 

1977 

50.891 

50.891 

3.439 

6.758 

2.343 

1.096 

i 
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LOS  ANGELES  DISTRICT 


FY 

ECC 

($  Mil) 

Adj  ECC 
($  Mil) 

E&D  Cost 
($  Mil) 

E&D  Rate 

m 

Contract 
E&D  Cost 
($  Mil) 

In-House 

E&D  Cost 
($  Mil) 

1969 

57.364 

60.738 

4.039 

6.650 

<2.430 

1.609 

1970 

33.373 

35.336 

2.336 

6.611 

1.383 

.953 

1971 

3.257 

3.257 

.318 

9.764 

.280 

.038 

1972 

.658 

.658 

.110. 

16.717 

.088 

.022 

MEDITERRANEAN  DIVISION 


FY 

ECC 

($  Mil) 

Adj  ECC 
($  Mil) 

E&D  Cost 
($  Mil) 

E&D  Rate 
(%) 

Contract 
E&D  Cost 
($  Mill). 

In-House 

E&D  Cost 
(S  Mil) 

1969 

36.544 

35.694 

1.248 

3.225 

.453 

.795 

1970 

20.820 

22.045 

.907 

4.114 

.271 

.636 

1971 

13.844 

18.844 

.988 

7.187 

.431 

.555 

1972 

27.445 

27.445 

1.871 

6.817 

1.204 

.667 

1973 

20.695 

20.695 

1.646 

7.954 

.931 

.715 

1974 

96.356 

96.356 

3.165 

3.285 

- 

- 

1975 

1259.372 

1259.372 

9.505 

.755 

8.614 

.891; 

1976 

1890.213 

1890.213 

14.558 

.770 

13.824 

. 734* 

1977 

4516.357 

4516.357 

63.229 

1.400 

62.871 

.358 

- 
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MOBILE  DISTRICT 


FY 

ECC 

($  Mil) 

Adj  ECC 
($  Mil) 

E&D  Cost 
($'  Mil ) 

E&D  Rate 
(%) 

Contract 
E&D  Cost 
($  Mil) 

In-House 

E&D  Cost 
($  Mil) 

1969 

30.889 

32.706 

1.821 

5.568 

.374 

1.447 

1970 

63.821 

67.575 

2.976 

4.404 

1.429 

1.547 

1971 

71.261 

71.261 

3.162 

4.437 

1.120 

2.042 

1972 

95.799 

95.799 

4.241 

4.427 

2.293 

1. 948. 

1973 

79.929 

79.929 

5.087 

6.364 

3.450 

1.637 

1974 

129.964 

129.964 

6.591 

5.071 

5.131 

1.460 

19/5 

146.148 

146.148 

7.495 

5.128 

'5.690 

1.805 

1976 

151.946 

151.946 

8.520 

5.607 

6.884 

1.636 

1977 

124.984 

124.984 

7.616 

6.094 

6.694 

.922 

NEW  YORK  DISTRICT 

Contract 

In-House 

FY 

ECC 

Adj  ECC 

E&D  Cost 

E&D  Rate 

E&D  Cost 

E&D  Cost 

($  Mil) 

($  Mil) 

(S  Mil) 

(%) 

($  Mil) 

($  Mil) 

1969 

33.334 

35.295 

2.259 

6.400 

1.746 

.513 

1970 

30.393 

32.181 

2.382 

7.402 

1.349 

1.033 

1971 

27.104 

27.104 

1.735 

6.401 

1.129 

.606 

1972 

44.376 

44.376 

2.638 

5.945 

2.190 

.448 

1973 

60.947 

60.947 

3.470 

5.693 

2.968 

.502 

1974. 

43.805 

43.805 

2.735 

6.244 

1.698 

1.037 

1975 

42.084 

42.084 

2.618 

6.221 

1.530 

1.088 

1976 

42.873 

42.873 

2.633 

6.141 

2.000 

.633 

1977 

44.089 

44.089 

2.754 

6.246 

2.343 

.411 
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NORFOLK  DISTRICT 


FY 

ECC 

($  Mil) 

Adj  ECC 
($  Mil) 

E&D  Cost 
($  Mil) 

E&D  Rate 
{%) 

Contract 
E&D  Cost 
($  Mil  ) 

In-House 

E&D  Cost 
($  Mil) 

1969 

28.139 

29.794 

1.993, 

6.689 

1.308 

.-685 

1970 

29.068 

30.778 

2.306 

7.492 

1.-S07. 

.'499 

1971 

1972 

1973 

1974 

69.945 

69.945 

2.730 

3.903 

2.501 

.229 

1975 

76.553 

76.553 

3.522 

4.601 

2.956 

.566 

1976 

93.510 

93.510 

4.982 

5.328 

4.460 

.522 

1977 

61.574 

61.574 

3.465 

5.627 

2.427 

1.038 

OMAHA  DISTRICT 

« 

- 

Contract 

In-House 

FY 

ECC 

Adj.  ECC 

E&D  Cost 

E&D  Rate 

E&D  Cost 

E&D  Cost 

($  Mil) 

($  Mil ) 

($  Mil) 

(%) 

($  Mil) 

($  Mil) 

1969 

28.311 

29.976 

2.075 

6.922 

.942 

1.133 

1970 

72.893 

77.181 

4.211 

5.456 

1.870 

2.341 

1971* 

85.574 

85.574 

4.796 

5.605 

2.469 

2.327 

1972* 

130.335 

130.335 

6.752 

5.180 

5.374 

1.378 

1973* 

190.712 

190.712 

9.605 

5.036 

9.464 

.141 

1974* 

194.781 

194.781 

10.403 

5.341 

10.215 

.188 

1975* 

172.647 

172.647 

9.144 

5.296 

8.925 

.219 

1976 

162.186 

162.186 

9,698 

5.980 

7.451 

2.247 

1977 

.115.070 

115.070 

7.813 

6.790 

4.726 

3.087 

*Data  adjusted 

to  reflect  that  no  E&D 

was  performed  at 

Kansas  City  Di strict  for  FY71-75. 


SAVANNAH  DISTRICT . 

Contract  In-House 


FY 

ECC 

($  Mil) 

Adj  ECC 
($  Mil) 

E£D  Cost 
{$  Mil) 

1969 

58.247 

61.673 

3.005 

1970 

59.922 

63.447 

3.489 

1971 

41.497 

41.497 

2.201 

1972 

66.512 

66.512 

3.295 

1973 

67.684 

67.684 

3.204 

1974 

105.320 

105.320 

3.970 

1975 

169.654 

169.654 

8.266 

1976 

168.141 

168.141 

8.565 

1977 

172.643 

172.643 

9.723 

E&D  Rate  E&D  Cost  E&D  Cost 


(%) 

-($  Mil) 

($  Mil) 

4.872 

1.593 

1.412 

5.499 

2.086 

1.403 

5.304 

.676 

1.525 

4.954 

1.666 

1.629 

4.734 

1.693 

1.511 

3.769 

2.487 

1.483 

4.872 

7.050 

1.216 

5.094 

8.090 

.475 

5.632 

8.510 

1.212 
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APPENDIX  B: 

MODEL  DEVELOPMENT  AND  DATA  ADJUSTMENTS 


Model  Development 

In  CERL  Report  P-77,  O'Connor  developed  the  model  (Eq  1)  used  in 
this  report  to  estimate  in-house  and  contract  E&D  costs  from  the  yearly 
ECC  for  a Division/District.  Visual  inspection  of  graphs  of  the  data 
(E&D  costs)  plotted  against  time  (Figures  BDthrough  B9)  Indicated  that 
the  Inclusion  of  a quadrat^  term  in  time,  T , might  improve  the  predic- 
tive ability  of  the  model  for  AEED  costs  for  Alaska,  Baltimore,  Fort 
Worth,  Omaha,,  and  Savannah  Districts.  However,  regression  analyses 
showed  no  significant  Improvement  In  the  fit  of  data  when  the  quadratic 
term  was  used. 

The  possibility  of  grouping  Districts  with  homogeneous  residual 
variances  was  not  explored  In  depth  because  it  is  difficult  to  update 
data  files  for  such  groups.  Each  time  an  additional  year's  data  Is 
added  to  the  data  file,  the  groupings  must  be  checked.  This  would  in- 
volve statistical  comparisons  of  Divisions  and  Districts,  and  the  TEK- 
TRONIX System- Is  not  adaptable  to  this  type  of  analysis.  Instead,  a 
specific  set  of  coefficients  was  computed  for  the  model  for  each  Di- 
vision/District. 


Data  Adjustments 


Prior  to  FY71,  the  ECC  was  defined  as  85  percent  of  the  programmed 
cost  or,  if  the  programmed  cost  was  net  established,  the  equivalent 
cost.  In  FY71,  this  percentage  was  changed  to  90  percent.  The  FY69  and 
FY70  data  were  adjusted  accordingly  by  multiplying  by  .9/. 85. 

Baltimore  and  Omaha  data  required  special  adjustments,  because  Bal- 
timore performed  E&D  for  Norfolk  l.i  FY71  through  FY73,  while  Omaha  did 
likewise  for  Kansas  City  in  FY71  through  FY74.  Linear  regressions  were 
used  to  fit  lines  to  the  Norfolk  and  Kansas  City  data.  These  provided 
estimates  of  INHED,  AEED,  and  ECC  for  the  missing  years  (see  Figures  BIO 
and  Bll).  These  estimated  values  were  then  subtracted  from  the  cor- 
responding year's  values  for  Baltimore  and  Omaha.  These  adjusted 
values,  which  are  given  in  Appendix  A and  in  Figures  B2  and  B6,  were 
used  to  develop  the  prediction  models  for  Baltimore  and  Omaha. 
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